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Abstract. The tetrablock is shown to be inhomogeneous and its automorphism group is 
determined. A type of Schwarz lemma for the tetrablock is proved. The action of the au- 
tomorphism group is described in terms of a certain natural foliation by complex geodesic 
discs. 



1. Introduction 

The tetrablock is the domain E in C 3 defined by 

E = {{xi, X2, X3) S C 3 : 1 — X\z — x 2 w + x^zw ^ for all z, w £ C such that \z\ < 1, \w\ < 1}. 

E is a non-convex domain whose intersection with K 3 is a regular tetrahedron. It is of interest 
because of its relation to a certain function-theoretic problem that arises in control engineering; 
see Section |6] below. In this paper we answer three questions: is E homogeneous? Is E an analytic 
retract of the unit ball of the space of 2 x 2 matrices? What is the full group of automorphisms 
of E? Here an automorphism of a domain Q is an analytic bijective self-map of f2 having an 
analytic inverse. 

In Section [2] we prove a Schwarz lemma for E: we find necessary and sufficient conditions on 
y G C 3 for the existence of an analytic map (p : B — ► E, where D is the open unit disc, such that 
<p(Q) = (0, 0, 0) and (p'(0) = y and we give a formula for a suitable <p. This result enables us to 
show in Section [3] that E is inhomogeneous; the proof uses E. Cartan's classification of bounded 
homogeneous domains in C 3 and a little elementary theory of J*-algebras. We also show that E 
is not an analytic retract of any bounded symmetric homogeneous domain of dimension less than 
16. In Section[4]we determine the automorphism group of E, thereby verifying a conjecture made 
in [2] . In Section [5] we show that the action of the automorphism group of E can be understood 
in terms of a certain natural foliation of E by analytic discs; the group permutes the leaves of 
this foliation transitively, and the orbits of the group are naturally parametrised by the interval 

[0,1). 

The connection between the geometry of E and the problem of "/x-synthesis" from control 
engineering is outlined in [2j Section 9] and references cited there. 

We shall denote the closure of E by E and the closed unit disc by A. We write O for the origin 
(0,0,0) in C 3 . The automorphism group of a domain f2 will be denoted by Autfi. If H, K are 
Hilbert spaces then £(H, K) denotes the linear space of bounded linear operators from H to K 
with the operator norm. C 2x2 denotes the space of 2 x 2 complex matrices with the standard 
C* norm. An important role in the analysis of E is played by the map 

(1.1) 7T : C 2x2 -> C 3 : [a l3 ] h-» (o U) a 22 , det[ay]). 

We shall write £2x2 f° r the set of analytic functions F : D — > C 2x2 such that ||F(A)|| < 1 for all 

AeD. 
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Let us recapitulate here some of the eleven different characterizations of E from [2] . For present 
purposes four will suffice. One of them uses the rational function 

(1.2) *(z,x 1 ,x 2 ,x 3 ) = X3Z ~* 1 . 

X2Z — 1 

Roughly speaking we identify x G C 3 with the linear fractional transformation ^(.,x); then 
x G IE if and only if x corresponds to a linear fractional transformation whose supremum on D 
is less than one. This statement is not quite precise, since if x±X2 — X3 then ty(.,x) is constant 
and equal to x\. Points x for which X\x% = £3 are called triangular points; they require special 
treatment. 

Theorem 1.1. For x = (x\, x%, x 3 ) G C 3 the following are equivalent. 

(1) x G E; 

(2) \xi - x 2 x 3 \ + \xix 2 - x 3 \ < 1 - \x 2 \ 2 ; 

(3) sup zgD \^&(z, x) I < 1 and if x 1X2 — x 3 then, in addition, \x2\ < 1; 

(4) there exists a symmetric matrix A G C 2x2 such that \\A\\ < 1 and tt(A) = x; 

(5) there exist /3i,/?2 G C such that \{3\\ + |/3a| < 1 and 

Xl = 01 + i3 2 Xz, X 2 = 02 + P1X3. 

For the proof see [3J Theorem 2.1]. Some basic complex geometry of E is described in this 
reference. For example, E is starlike about the origin, is polynomially convex, has a distinguished 
boundary of 3 real dimensions and admits a group of automorphisms of 6 real dimensions. 

Condition (iv) reveals a close connection between E and the two Cartan domains i?/(2, 2) and 
i?//(2), defined to be the open unit balls in the spaces of 2 x 2 matrices and symmetric 2x2 
matrices respectively: 

E = n(R I {2,2)) = n(R II (2)). 
The homogeneity of i?/(2, 2) was used in [2] to prove a Schwarz lemma for E, that is, a criterion 
for the solvability of certain 2-point interpolation problems for analytic functions from D to E. 
In the next section a similar method is used to prove the other sort of Schwarz lemma for E: a 
criterion is found for the existence of an analytic function from D to E with a prescribed value 
and derivative at a single point. 

2. A Schwarz lemma for the tetrablock 

Theorem 2.1. Let y G C 3 . There exists an analytic map ip : P — > E such that tp(0) — O and 
tp'(0) — y if and only if 

(2-1) max{|y 1 |,|y 2 |} + | 2 / 3 | < 1. 

Proof. Suppose such a <p exists. Write <p = (ipi, tp 2 , <p 3 ). By [H Theorem 1.2], for any A 6 D, 

- (p2Vz){\)\ + \(<fl<f2 ~ 13)(A)| [Qg2 - <filf3)W\ + |(lll2 - <g3)(A)| 1 

1-MA)| 2 ' i-MA)| 2 J 

Divide through by |A| and let A — > to obtain 

max{|^(0)| + 1^(0)1, |/(0)| + |/(0)|} < 1. 

Since /(0) = y we have 

max {|yi|, \yz\} + I j/3 I < 1, 

and the inequality (|2.ip is necessary for the existence of ip. 

Conversely, suppose that (|2.1|) holds. We can suppose that \yi\ > \y2\- If yi = then also 
y-2 = 0, I2/3 1 < 1 and the function tp(X) = (0,0, Xy 3 ) is sufficient. We may therefore assume that 
yi 7^ 0. We shall construct F G ^2x2 such that <p — it o F has the desired properties. Note that 



< 
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since 7r(i?/(2, 2)) = E, for F £ 52x2, <p maps D into E. Let C & D be a number to be chosen later 
and let F = [Fij] satisfy 



(2.2) 



F(0) 



o c 





Then tp(0) = O and 

p'(0) = (7roF)'(0) = (F^F^Fl^ +F n F^ 2 
= {F[x,F^, -C^2i)(0). 
Thus y'(0) = y if and only if 



F{ 2 F 21 - F 12 F^)(0) 



(2.3) 



F'(0) 



2/1 * 
-2/3/C 2/2 



Accordingly our task is to find C G © an d -F 1 S ^2x2 such that the equations (|2.2p and (|2.3p are 
satisfied. 

We shall use the matricial Mobius transformation M.z of 2 x 2 matrices defined, for any strict 
2x2 contraction Z by 

Mz{X) = -Z + D z ,X(l - Z*X)- 1 D Z , 

1 

where Dz = (1 — Z* Z) 2 . The transformation Adz is an automorphism of the unit ball Ri(2, 2) 
of C 2x2 , has inverse M.-z and maps Z to 0. We have, for any F £ £2x2, 

(M Z °F)' = D Z *[F'(1- Z*F)- 1 +F(1- Z*F)- 1 Z*F'(1- Z*F)- 1 }D Z 

(2.4) = D z *(l — FZ*)~ l F'(l — Z*F)~ l Dz- 

Let 



(2.5) 



C 




for some C £ Then Z is a strict contraction and 

1 



D>z* = 



(i-|CI 2 ) 2 

Hence, if F satisfies equations (|2.2[) and (|2.3p . then 

(MzoF)'(O) = D z lF\Q)D z l 

yi 



(2.6) 



(l-ICl 2 ) 2 

C 



(i-|C| 2 )2 
1 



F[ 2 (0) 

1-ICI 2 

2/2 



(i-ICI 2 ) 2 

If the required i* 1 exists then, by the Schwarz Lemma for i?/(2, 2), the right hand side of equation 
(12. 6[) is a strict contraction. We shall show that F exists by working back from equation (|2.6|) . 
The choice ( = \/l — in equation (|2.6p leads us to define 

2/i , 



(2.7) 



12/1I 2 
2/3 



2/2 

I2/1I 2 
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for some £ £ C. Since, by hypothesis, \ys\ < 1 — |yi|, the first column of Y(£) has norm 



2/1 I 



i-M 



<ilyil + 



ll/3|(l-|»l|) 



2 ={|yil + bl}2 <i, 



i I2/1I 

and since 1 3/2 1 < |yi|, the second row of Y(£) also has norm at most 1. By Parrott's Theorem 
([13] or [T31 Theorem 12.22]) there exists £ e C such that ||Y(£)|| < 1; in fact, a suitable choice 
is 

ymmV 1 - M 



(2.8) 



l2/i|(i-M-|y 3 | 2 r 

Let H(X) = \Y{£),\ e P. Then # e <S 2 x2 and 

ff(0) = 0, ff'(0) = Y(0- 
Define F = M.-z H, where as before Z is the right hand side of equation (|2.2| . and now 
C = v 7 ! - \y~l\- Then F E 5 2x2 , 



F(0) =M- Z (0) = Z = 



C 





and 



F'(0) = {M-z°Hy(0) = {D z *(l + HZ*)- 1 H'(l + Z*H)- 1 Dz)(0) 
= Dz*Y(t)B z 

yi 



l2/x 1 2 
1 



yi 

-J/3/C 2/2 



12/1 



2 
2/3 



la/a. I = 



1 







|yi|2 



On comparison with equations (|2.2[) and (|2.3p we find that ip = tt o F satisfies the requirements 
of the theorem. 

We can extract from the above proof an explicit formula for ip satisfying the conditions of the 
theorem. 



Theorem 2.2. Let y s C 3 be such that max{|yi|, I2/2I} + I2/3I < 1- Let p 



be given by 



(2.9) 

where 

(2.10) 



A 



1 + Xy 3 C(y) 



(yi,y2,C(y)X + y 3 ) 



C(y) = 





2/13/2(1 - M) 

l2/i|(l-|2/i|-bl 2 ) 
2/12/2(1 - I2/2I) 



*/ 2/1 = 2/2 = 

|2/2|<bi|^0 



*/ lift I < |2/2| 7^0. 



I I2/2K1-I2/2M2/3I 2 ) 

Then ip is an analytic map from H5 to E, ^(0) = O and <p'(0) = y. 

Proof. We considered the case y\ = 2/2 = in the proof of Theorem 12.11 Suppose without loss 
that I2/2I < 1 2/1 1 7^ 0. It is immediate that <p as defined satisfies ip(0) = 0, </?'(0) — y; the task is to 
show that ip is analytic and ^(P) C E. 
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let 



Choose £ = \J\ — | yi | and Z. £, F = Y(£) as in equations 



. (|2.7p respectively, and 



F(A) = X_ Z (AF) = Z + D Z *\Y(1 + \Z*Y)- 1 D Z 
= Z + \(D z *YD z )(l + \Z*D z lYD z )- 1 . 



As we observed in the proof of Theorem 12.11 F G 5 2 x 2 • We have 



£>*.YD* = 



2/1 Clml 

-2/3/C 2/2 



, D z lYD z = 



Hence 



F(A) = Z + A(L> z .y£> z ) ( 1 + A 
A 





C 



M ? 
-2/3/C 2/2 

-Ml. f " 
-2/3/C 2/2 



1 + A^C 



2/1 CI2/1I 

2/3/C 2/2 



1 + A£C 



(2.11) 

where 

(2.12) 

We find that 
Note that 
We have 





" c " 


A 


2/1 


CI2/1I " 







+ 1 + ACC 


w 


2/2 


w — w(X) - 


= -fd 


-f-Aeo-^ 2 

M 


2/3 

c 



AC 3 2/i2/2 



C l2/i|(l-|2/iM2/3| 2 ) 



2/3 



det F(A) 

cc = 



A V / T 3 r2^C Y (2/)- 



A 2 (2/i2/2 - KI2/1I) _ Awy/1 - I2/1 

(1 + ACC) 2 
2/12/22/3(1 - I2/1I) 



I2/1KI-I2/1M2/3I 



i + Aec 

y 3 c(y). 



2/12/2 - w(\)£\yi \ = 



2/12/2(1 - I2/1I) . Ay 3 / 2/12/2(1 - I2/1 



l-|2/i|"l2/ 3 | 2 |ml \l-\Vi\-\ua 



and so 
detF(A) = 



A 



1 + Az7 3 C(y) 
A 



(y 3 + X(l-\ yi \)C(y)) + 
(C(y)X + y 3 ). 



A 



1 + Xy 3 C(y) 



= \ yi \C(y)(l + Xy 3 C(y)), 



\ yi \C(y)(l + Xy 3 C(y)) 



1 + Ay 3 C(y) 

Since F G 5 2X 2 the map tt o F is analytic, maps D to E and satisfies (compare equation l|2.11jl ) 

Xyi 



(ttoF)i(A) = Fn(A) 
(7roF) 2 (A) = F 22 (A) 



1 + Ay 3 C%) ■ 
A2/2 



1 + Ay 3 C(2/) 

(7roF) 3 (A) = detF(X) = 1T ^-—r (C( y )X + y 3 ). 
Comparison with equation (|2.9p shows that 7r o F = ip, and hence tp has the required properties. 
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Remark 2.1. In the event that the necessary condition of Theorem 12 . 1 1 holds with equality, that 
is, 

max{|yi|, \y 2 \} + | j/3 1 = 1, 

the function ip of Theorem 12. 21 is a complex geodesic of E (that is, it has an analytic left inverse). 
Suppose that j 2/2 1 < \yi\ ^ and \yi\ + \y 3 \ = 1. Choose u)\, u> 3 £ T such that uj\y\ = \y\\,L0 3 y 3 = 
Ij/al; then uiyi + uj 3 y 3 = 1. For any z £ A the rational function ^(z, .) given by equation p.2p 
maps E analytically into D. We have 

ip(\)) = y3(A)^-yi(A) = A _ (CX + y 3 p y x 



ip 2 (X)u; - 1 Xy 2 bj - (1 + Cy 3 X) 

where (since 1 — \yi \ = 1 2/3 1 ) 

c = cm = y^ 2 ^ = y^ 2 = vi 

1 2/x I C 1 2/3 j - 1 3/3 1 2 ) \y\\ 2 m 

Choose uj = — H11UJ3. A little calculation gives the relation 

ty(bJ,tp(X)) = u>x\. 

Hence uji^(uj, .) : E — > E5 is an analytic left inverse of ip, and so <p is a complex geodesic of E. 

One might expect (by analogy with the case of the unit disc) that in the extremal case ip 
should be E-inner |T], that is, the radial limit function of tp should map T almost everywhere 
into the distinguished boundary bE of E. In fact 6E is the intersection of the closure E of E with 
the set {x € C 3 : 1 0:3 1 = 1} [H Theorem 7.1], and so an analytic map ip : B — > E is E-inner if and 
only if 933 is a scalar inner function. For the function ip of the theorem, ip 3 is inner if and only if 
y is "doubly extremal", that is, \yi\ = \y 2 \ = 1 — |j/3|- 



3. The tetrablock is inhomogeneous 

We shall show that the inhomogeneity of E follows from Theorem 12.11 and E. Cartan's clas- 
sification of bounded homogeneous domains [71 page 313]. We use L. A. Harris' theory of J*- 
algebras[8j. A J*-algebra is a closed subspace A of the Banach space C(H,K), for some Hubert 
spaces H, K, with the property that T € A implies TT*T £ A. The importance of such algebras 
here is that, in dimensions up to 15, every bounded symmetric homogeneous domain is isomor- 
phic to the open unit ball of a J*-algebra. A domain Q is said to be symmetric if, for every 
z £ fi, there is an analytic involution of f2 of which z is an isolated fixed point. 

A domain f2i is said to be an analytic retract of a domain O2 if there exist analytic maps 
h : Qi — > Q2, k '■ ^2 — ► Oi such that k o h = idg. We define the indicatrix I (CI, a) of a domain CI 
at a point a £ Cl to be the set 

I(Cl, a) = {<p'(0) ■ p> is an analytic map from D to Cl, <p(0) = a}. 

It follows from the chain rule that if h : Cl\ C C n — ► Cl 2 is analytic and a £ Cli then h'(a)I(Cli, a) C 
/(O2, h(a)). If, further, h has an analytic left inverse K, then k! oh(a)h! (d) is the identity operator 
on C™, and so k o /i(a) is a linear operator that maps I(Cl2, h(a)) surjectively onto I(Cl±, a). 

We recall jH] that the rank of a J*-algebra ^4 is the supremum of the number of non-zero 
elements in the spectrum of T*T over all T £ A; it is also equal to the maximum cardinality of 
any set of mutually orthogonal non-zero minimal partial isometries in A [9, Corollary 5]. Every 
finite-dimensional J*-algebra clearly has finite rank. 

Theorem 3.1. E is not an analytic retract of the open unit ball of any J* -algebra of finite rank. 
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Proof. Let A C C(H, K) be a J*-algebra of rank r < oo, B its open unit ball. Suppose that 
h : E • /<. /-• : II ■ E are analytic and K o h = idg,. Since the open unit ball of a J*-algcbra 
is homogeneous, we may replace h, k by their compositions with automorphisms of B to ensure 
that h(0) = 0. By Theorem O 

J(E,0) - {y G C 3 : maxfj^l, \y 2 \} + \y 3 \ < 1}. 

It is easy to see that I(B,0) is the closed unit ball B of A. Indeed, if T G B then the function 
tp(X) = XT maps B to B and to and satisfies <p'(Q) = T, so that I(B,0) D B, while if 
if : D — > B is analytic and maps to then the Schwarz lemma for P applied to the scalar 
functions {ip(.)^,r]) , £ € H,T) G K shows that y'(0) G -B. 

/(E, 0) is the closed unit ball of C 3 with respect to the norm 

= max{|yi|, |y 2 |} + l^l- 

Since the linear operators h'(0) : C 3 — » A,k'(Q) : — > C 3 are contractions with respect to 
||-||e) ll-IU an d k'(0)/i'(0) is the identity operator on C 3 , it follows that h'(0) is an isometry. Let 
/i'(0)(l,0,0) = A,fr'(0)(0,0,l) = B. Then for any A,/i e C, 

(3.1) ||AA + M B|| £(H ,K) = ||/i'(0)(A,0, M )|| = ||(A,0,/i)|| E = |A| + | M |; 

in particular, \\A\\ = \\B\\ = 1. By [9l Proposition 4], every element T E A has a singular value 
decomposition 

m 

T = ^ s k V k 

k=l 

where m < r, each Sk > and the Vk € A are mutually orthogonal non-zero minimal partial 
isometries. Let cj±, u>2, ■ • ■ be an infinite sequence of distinct points in T. Since | \A + oj\B\ \ = 2 
we can write down the singular value decomposition 

A + luiB = 2Vi + • • ■ + 2V ni + iii 

where 1 < n\ < r, Ri S A, \\Ri\\ < 1 and R\ is orthogonal to Vi,...,V ni . The space of 
maximising vectors oi A-\- uj\B is 

M 1 =span{V 1 *Jf,...,V„*if}. 

For a; 6 Mi we have 

2||a;|| = WAx + ujxBxW < \\Ax\\ + \\Bx\\ < 2\\x\\. 

It follows that = ||x|| = ||Bx||. Moreover, the parallelogram law shows that Ax = w\Bx. 

Hence, for x G Mi, 

2Ax ={A + uj 1 B)x = 2Vix H h 2V ni x. 

Thus we can write 

(3.2) A = V 1 + --- + V ni +A 1 

(3.3) w x B = Vi + ■ ■ ■ + V ni + ujxB x 

where Ax.Bi G A, A\ and B\ are both orthogonal to V\, . . . , V ni and \ \Ai +uiBi\ \ < 2. For any 
w eT,u)^w 1 ,\\A + u)B\\ = 2 and 

A + luB = (1+ljQi)(Vi H l-Kj+^i +loB x . 

Since w ^ ui we have |1 + u>u)\\ < 2. Hence \\Ai + ojBi\\ = 2 for any oj G T \ {u>i} and by the 
same arguments we have 

A x = V ni+1 + --- + V n2 +A 2 , 

(3.4) u 2 Bi = V ni+ i + ■ ■ ■ + V n2 + uj 2 B 2 
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where A2, B2 G A, A2 and B2 are both orthogonal to Pi, ... , V n2 and \\An + u)jB2\\ < 2, j = 1,2. 
This process terminates after at most r steps. If we write W\ = Vi + ■ ■ ■ + V ni etc. then, for 
some N < r, 

A = W 1 +W 2 + --- + W N , 

B = uixWi + Q2W2 + •••+ u>n Wn 

where W\ , . . . , Wn are mutually orthogonal non-zero partial isometries in A. Choose u> G T 
different from u>x, . . . , u>n: then 

\\A + U)B\\ = ||(1 + wuixjWi H h (1 +ujQ n )Wn\\ = max \l + vQj\<2, 

l<j<N 

contrary to equation (|3.ip . Hence the postulated maps h, k do not exist. 
Corollary 3.2. E is inhomogeneous. 

Proof. E. Cartan showed that every bounded homogeneous domain in C 3 is symmetric [7J page 
313] . Every bounded symmetric homogeneous domain in C™, n < 15, is the open unit ball of a J*- 
algebra |8j Theorem 7]. E is bounded, and so if E is homogeneous then E is isomorphic to the open 
unit ball of a 3-dimensional J*-algebra, contrary to Theorem 13. II Hence E is inhomogeneous. 



4. The automorphism group of the tetrablock 

Although the automorphism group AutE does not act transitively on E, it is nevertheless 
quite large: there are commuting left and right actions of AutlS on E [21 Theorem 6.8]. These 
two actions together with the "flip" automorphism F : (x\, X2, £3) 1— * (£2, £1,^3) give a group 
G of automorphisms of E, and we conjectured in [2] that in fact G — Aut E. In this section we 
prove that the conjecture is correct. 

Roughly speaking, the actions of Aut D on E are by composition. Consider 16E and i/gE. 
The linear fractional maps Si?(.,x), i f?(.,y) given by equation (|1.2| map A into A,D respectively 
[21 Theorems 2.4 and 2.7], and a simple calculation yields the relation 

V(.,x)oiZ>(.,y) = V(.,xoy) 

where 

(4.1) xoy = (xi - x 3 y!,y 2 - x 2 y3,X!y2 - x 3 y 3 ) 

1 - x 2 yi 

= U yi ,x)M^F(y)), X f- X3V3 ). 
V 1 - x 2 yi J 

We define x o y by equation (|4.1|1 for any x,y G C 3 such that X2yi 7^ 1- Consider v G AutD: 
we can write v — ^(.j t(v)) for some t(v) G E. The left action of AutD on E or E is given by 
v ■ x — t(v) o x, or equivalently ^(-, v ■ x) = v o $(., x). Similarly one defines a right action by 
x ■ v = xot(v),x G E,i> G AutD. Fuller details of the construction are given in [21 Section 6]. If 
L v , R x for any v, \ G Aut D are given by L v (x) = v ■ x, R x {x) — x • x then L Vl R x are commuting 
elements of AutE. Moreover, L V L X — L vox and there is an involution v i-> t), on AutD such 
that FL V = for any v G AutD. It follows that 

(4.2) G d = {L V R X F V : v, X G Aut D, v = or 1} 
is a subgroup of AutE. 



Theorem 4.1. 



AutE = G. 
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The proof is based on the ideas of M. Jarnicki and P. Pflug in their determination of the 
automorphism group of the symmetrised bidisc [10] : the author and J. Agler had previously 
found a more elementary but longer proof of the same result. An important role in the proof 
is played by the rotations p u G AutD, defined by Puj(z) — loz. It is easy to show that, for any 
oj G T and xGE, 

■ X — ((jJXl,X2,U)X3), X ■ Puj — (XI,L0X 2 ,LUX3). 

Lemma 4.2. Any automorphism of E that fixes every triangular point of E is the identity 
automorphism o/E. 

Proof. Let h G AutE fix all triangular points: h(xi, x%, X1X2) — (xi, X2, X\x 2 ) for all x\, x 2 G ED. 
We have 

" 1 a 

(4.3) h'(0) =016 

0c 

for some a.b.c G C. For u> G T let H u be the element h^ 1 o L 0l , oho L of AutE. Then 



H u (0) = (O) and 

H'JO) = //(0)-Miag(w,l,w)//(0)diag(w,l,w) = 
If H% denotes the nth iterate of ff u then 

(iC)'(o) = K(o) n = 



Pl/U 

1 
1 






b(LU - 1) 

1 







nb(uj — 1) 







Now the isotropy group K of the origin in E, that is the group {/ G AutE : f(0) = O}, is 
compact with respect to the topology of locally uniform convergence, the map / f'(O) is 
continuous on AutE and each H£ G K. Hence the matrices (ff™)'(0),n > 1, are uniformly 
bounded. It follows that 6 = 0. Similarly we have a = (replace L Pa by R Pu> in the above 
argument). Thus h'(0) is diagonal and H'^O) is the identity matrix. By Cartan's theorem (e.g. 
[12] Proposition 10.1.1]) H u is the identity automorphism, and so h o L Pui — L Pu o h. Similarly 
h o R Pui = R Puj oh. If h = (hi, hi, ft-3) then, for x G E and weT, 

h (ojx i,x 2 ,wxa) = (ujhi(x),h 2 (x),ujh 3 (x)), 
h(xi, U)X2, = (hi(x),ujh2(x),ujh 3 (x)). 

By the former equation, for fixed X2, 6:2 is homogeneous of degree in ^1,0:3 while h\,h 3 are 
homogeneous of degree 1 in x\,x 3 . Similarly, for fixed x\, hi is homogeneous of degree and 
h>2, are homogeneous of degree 1 in x 2 , x 3 . It follows that 

h(x) = (axi, (3x 2l 7x1X2 + 6x3) 

for some a, j3, 7, S G C. Comparison with equation (|4.3|) shows that a = j3=l,5 = cj^0. Since 
h fixes triangular points, 7 = 1 — c and so h(x) — (xx,x 2 , (1 — c)x\X2 +0x3). We must prove that 
c = 1. 

Observe that h and /i" 1 are polynomial maps and therefore extend continuously to E. Hence 
h induces an automorphism of the algebra A(E) of continuous scalar functions on E that are 
analytic on E, and consequently h maps the Shilov boundary 6E of A(K) to itself. According to [2 
Theorem 7.1], x G 6E if and only if x\ — X2X3, \x 2 \ < 1 and \x3\ = 1. For x — {X2X3, x 2 , X3) G 6E 
we have 

1 = |/l3(3;) I = 1(1 _ c)x 2 X3X2 + CX3\ = 1(1 - c)\x 2 \ 2 + c| . 
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Since this relation holds whenever \x2\ < 1 we have c = 1 and hence h is the identity map. 
Proof, [of Theorem 14. 1| Recall that x € E is said to be triangular if x\X2 — X3. We denote by 
T the set of triangular points. Note that x is triangular if and only if ^(.j x) is a constant map. 
It follows that if x £ T and v £ Aut D then the maps 

*(., V ■ x) =«of(.,l), t>) = o u 

are constant, and hence v ■ x, x ■ v £ T . It is clear that T is invariant under F and under L v , R v 
for any v £ AutO, and so T is invariant under the group G given by equation (|4.2p . Moreover, 
if x £ T and we define 

(4.4) v{z) = l^L, x{z) " 



X\Z — 1 ' X2Z — 1 

then we find that v ■ x ■ x = O. Hence T is the G-orbit of O in E. 

Let V denote the orbit of O under AutE. Clearly V D T. By [Til Satz 1], V is a closed 
connected complex submanifold of E. Since E is inhomogeneous, V ^ E. If V is a 3-dimensional 
submanifold of E then V is both open and closed in E, and so by connectedness V — E, a 
contradiction. Thus V is a connected 2-dimensional submanifold of E. Since T is closed in E it 
follows that T is an open and closed subset of V, hence by connectedness is equal to V. That is, 
T is the orbit of O under AutE. Hence every automorphism of E restricts to an automorphism 
of T. 

Consider any / £ AutE. Let f(0) = x, so that x £ T. Define v,x as in equations (|4.4[) 
and let <?(.) = v ■ /(.) • X- Then g £ AutE and g(0) = O. The restriction gj- of g to T is an 
automorphism of T. Since T is isomorphic to the bidisc ID 2 , (77- induces an automorphism of D 2 
that fixes (0, 0). Hence gr is one of the automorphisms 

(xi, x<z, X\ X2) i-> (ujxi,riX2,ujr]XiX2) or (xi,X2,xix 2 ) ^ (r]x 2 ,ujXi,ujr]XiX2) 

for some 01,77 £ T. In the former case let h(.) = pa ■ g(.) ■ p^. then h £ AutE and h fixes T 
pointwise. By Lemma 14.21 /i is the identity map idg. Thus g = p^ ■ idg • Pjj and so 

/ = L v R x g = L VOPhj R Pr]OX £ G. 

In the latter case a similar argument shows that 

/ = I J v op v Rp^oxF ^ 

Thus in either case / £ G. 

5. The action of AutE on a foliation 
Condition (v) of Theorem 1 1 . 1 1 shows that if |/3i| + |/3a| < 1 then the function 

Vfrfr : D -> C 3 : A ~ + ^ 2 A, /? 2 + ^A, A) 

maps D into E, and moreover every point of E lies on some disc </?a 1( 3 2 (D). If x = t fj3 1 p 2 {\) then 
we find that 

_ xi - x 2 X _ x 2 - XiA 

Pl ~ 1-|A| 2 ' 12 ~ 1-|A| 2 ' 

and so x lies in a unique disc (^^(B). Thus the discs (O), |/3i| + \@2\ < 1, constitute a 

foliation of E by analytic discs, which we shall call the (3-foliation of E. It is easily checked that 
^(o>, .) is an analytic left inverse of <pp 1 f3 2 modulo AutD for any o> £ T, and hence the leaves of 
the /3-foliation are complex geodesies of E. 

The action of Aut E can be understood in terms of its action on the /3-foliation. 
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Theorem 5.1. AutE permutes the leaves of the /3-foliation transitively. Specifically, if x £ 
(P) an d v i X G Aut D are given by 

(5.1) v{z) = u^-, x ( z) = C .p± 

az — 1 Oz — 1 

then x ■ x £ ^ii^fW where 

,, 9 , /?l(l-l^l 2 ) = g(l-|A| 2 + |fe| 2 )-C/?2-C^/32 

1 j 71 |1-CW-|W 72 |l-C^ 2 | 2 -|^i| 2 

and w • x € ipsi5 2 (P) where 



Q'(l-|/3 2 | 2 + |/3i| 2 )-/3i-a 2 ^ r A(l-|a 



2\ 



(5.3) * " |l-a/3i| 2 -|a/3 2 | 2 ' & |1 - <5/3i| 2 - |a/3 2 | 2 ' 
Moreover, for any /3i,/3 2 smc/i </ia£ + | /3s | < 1, if v,x in equations k5.1\) are chosen with 
w = C = l, 

(5.4) a = Cit^ltanh-^l/Jil + IAIJ + ^tanh-^IAI-IAI)}, 
= ^tanhjitanh-^l^l + I^D-itanh^^l/?!!-!^!)} 

w/iere /3i = ffa = |/32^2 and £1, £2 £ T, i/ien 

u- 1 • mfh (B) • x- 1 = ^ 00 (B) = {(0, 0, A) : A e ©}. 
Proof. A straightforward calculation shows that 

(5.5) <Pp 1 fhW'X = <Pin3(l J >) 
where 

(5-6) M = , r , ??=-Cq 7^5-, c 



cA + 1' ' M-C^ 2 ' l-C0/?a 
and 71 , 72 are given by equations (|5.2p . Similarly 

v ■ ( P0x0 2 W = l fs 1 s 2 {v) 

where 

, A + c' , l-a/?i , a/3 2 

c'A + 1 1 — api 1 — api 

and 5i,<52 are given by equations (|5.3p . Since |c| < 1, |c'| < 1, \r\\ — 1 and \rj'\ — 1, both L„ and 
i? x map any /3-leaf bijectively onto another /3-leaf. As F clearly does likewise, it follows that 
every automorphism of E permutes the leaves of the /3-foliation. 

On applying equations (15. 3|) and (15. 2|) to the case j3\ — 02 — we find that 

(5.8) v • ^oo(B) • X = <yV Q) o(©) • X - <^ 7l72 (©) 

where 

1 j 71 1 - Ml 2 ' 72 1 - Ml 2 • 

Consider /3i,/?2 such that \(3i\ + |/3a| < 1. Choose w = C = 1 an d choose a, according to 
equations (|5.4p : note that a < 1, # < 1 since \f3i\ + |/?2 < 1, and £i|a| = a, £2!$ = 
Furthermore 

taiih^lal = itanh-^l^il + I^D + itanh^d/Sil-l^l), 
tanh" 1 ^! = itanh-^IAI + I^D-itanh^d/Sil-l^l), 
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whence 

tanh" 1 \a\ + tanh" 1 \6\ = taim -1 ^! + \fj 2 \), tanh -1 \a\ - tanh" 1 \6\ = tanh _1 (|/3i| - |/3 2 |). 
On taking tanh of both sides we obtain 



1 + Io0| lf ' " " 1 



and therefore 



= l-|afl|2 = 1- M |2 =71 

Thus u • <pqq(P) ■ x = ^/Sift.fW: as required. It follows that the action of AutE on the set of 
/3-leaves is transitive. 

The theorem shows that the orbit of any point of E under Aut E contains a point of the form 
(0,0, A) with A G B; the application of a further rotation shows that we may take < A < 1. 
The calculations above allow us to be precise. 

Theorem 5.2. Let x G E. The orbit of x under AutE contains a unique point of the form 
(0, 0, r) with r 6 [0,1). If ' x = (Pi + /3 2 A, /?2 + 0i\, A) then r is given by 

A — a( 



aOX-1 

where a, 9 are given by equations |5.^[ ). 

Proof. As in equations (|5.8p and (|5.9p we have, for v, \ given by equations (|5.1[) and z G 
where (by equations (|5.6p . I|5.7p ) 

z + C,a9 



(a6z + 1 ' 



V = —UJZ, [I = LjQ 

Now choose uj = ( = 1 and choose a, 6 as in equations (|5.4[) . As we showed above, 71 = /3i and 
72 = P 2 . Thus 

, , f z + af) 

v-mz)-X = <PM, \cWz~+l / 

Substitute z = (A — aff)/(—a6\ + 1) and apply a suitable rotation p to obtain 

u • p- (0,0, r) • x = <P/3iih(X) 

with r as in the theorem. 

It remains to prove the uniqueness of r. Suppose that (0, 0, r), (0, 0, s) both lie in the orbit 
of x with < r, s < 1; then there exist u, y G Aut D such that v ■ (0, 0, r) = (0, 0, s) ■ X ( we can 
ignore F here since both points are fixed by F). That is, if v,x are given by equations (|5.ip . 
f(uja)a{^ Lur ) — Poei^ C s )- ^ follows that a = 9 — and wr = £s. Since r, s > we have r = s. 

In [TJ Theorem 3.4.4] it is shown by a different method that, for every x G E, there exist 
v, x € Aut IS such that v ■ x ■ x — (0, 0, r) for some r G [0, 1); different formulae for v, x and r are 
obtained. 
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6. Concluding remarks 

The original purpose for the study of both the tetrablock and the symmetrised bidisc G was 
to try and solve special cases of the ^-synthesis problem ([3J Section 9], [HSU]) which is a 
refinement of classically-studied interpolation problems. Although the approach has indeed led 
to some new results which are relevant to the motivating engineering problem, the results so 
far are too special to be of great import in applications. It is reasonable to hope that a better 
understanding of the complex geometry of these domains and analogous ones will in the future 
provide results that will be very useful for the theory of H°° control. Meanwhile, the study 
of G has proved to be of considerable interest to specialists in several complex variables (e.g. 
[6l UOj ; numerous authors have developed the theory of G and its higher-dimensional analogues 
further). The appeal of these domains is that they admit a rich and explicit function theory 
that is in some ways close to that of classical domains, such as Cartan domains, but in others 
has new and subtle features. The present paper is more "several complex variables" than U H°° 
control": it addresses some of the basic questions one would ask about any domain of interest. 
It does however have some implications for cases of the /i-synthesis problem. For example, 
suppose we are given 2x2 complex matrices A, B with A — [A\ A%\ strictly triangular (but 
not 0) and B = [Bi B2] — not diagonal, and we are asked whether there exists an analytic 
matrix function F in the unit disc such that F(0) = A,F'(0) — B and fi(F(X)) < 1 for all 
A G D (here fi is a certain cost function lying between the spectral radius and the operator 
norm; see [U Section 9]). It follows from Theorem 12.11 above that such an F exists if and only if 
max{|6n|, I&22I} + \Ai A B2 + A2 A B\ \ < 1. Such explicit criteria for //-synthesis problems are 
hard to come by in general. Again, knowledge of the automorphisms of E reveals a non-obvious 
equivalence between certain /i-synthesis problems. 

References 

[1] A. A. Abouhajar, Function theory related to H°° control, Ph.D. thesis, Newcastle University, 2007. 
[2] A. A. Abouhajar, M. C. White and N. J. Young, A Schwarz lemma for a domain related to mu-synthesis, 
arXiv:0708.0637. 

[3] J. Agler and N. J. Young, The two-by-two spectral Nevanlinna-Pick problem, Trans. Amer. Math. Soc, Vol. 
356, No. 2 (2004), 573-585. 

[4] J. Agler and N. J. Young, The hyperbolic geometry of the symmetrized bidisc, J. Geom. Anal., Vol. 14, No. 
3 (2004), 375-403. 

[5] H. Bercovici, C. Foias, and A. Tannenbaum, A spectral commutant lifting theorem, Trans. Amer. Math. Soc, 

Vol. 325, No. 2 (1991), 741-763. 
[6] A. Edigarian and W. Zwonek, Geometry of the symmetrised polydisc, Archiv Math., 84(2005), 364-374. 
[7] B. A. Fuks, Special chapters in the theory of analytic functions of several complex variables, Translations of 

Mathematical Monographs 14 (American Mathematical Society, Providence RI, 1965). 
[8] L. A. Harris, Bounded symmetric homogeneous domains in infinite-dimensional spaces, in Proceedings on 

Infinite Dimensional Holomorphy, Springer Lecture Notes in Mathematics 364 (1973), 13-40. 
[9] L. A. Harris, Analytic invariants and the Schwarz-Pick inequality, Israel J. Math. 34 (1979), 177-197. 
[10] M. Jarnicki and P. Pflug, On automorphisms of the symmetrised bidisc, Arch. Math. (Basel) 83 (2004), no. 

3, 264-266. 

[11] W. Kaup, Uber das Randverhalten von holomorphen Automorphismen beschrankte Gebiete, Manuscripta 

Math. 3 (1970), 257-270. 
[12] S. G. Krantz, Function theory of several complex variables, Wiley, New York, 1982. 

[13] S. Parrott, On a quotient norm and the Sz.-Nagy-Foia§ lifting theorem, J. Functional Analysis 30 (1978), 
311-328. 

[14] N. J. Young, An introduction to Hilbert space, Cambridge University Press, Cambridge, 1988. 

N. J. Young- 
School of Mathematics 
Leeds University, England 



